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ABSTRACT 

Algebra I and General Mathematics courses using 
tutorial instructional programs under computer control supplemented 
by "off-line" materials (included in the computer controlled testing) 
have been developed for a ninth grade student population. This 
summary report (preliminary reports are EM Oil 046 and EM Oil 050, 
and the teacher's manual is EM Oil 054) describes the structure of 
the individually adaptive curriculum, the computer system and the 
curriculum development. Evaluations involving both normed and 
non-normed achievement tests suggest that students achieve at least 
as well with the use of computer assisted instruction as from 
conventional instruction alone. (EM Oil 037 through EM Oil 043, EM 
Oil 046, EM Oil 047, and EM Oil 049 through EM Oil 058 are related 
documents.) (RH) 
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The Peveloor:ent, Jiijo^einentation and Evaluation of a 
^^lot ?ro^}rari\ of Computer-Assisted Instruction 
fo«" Urban Hinh Schools: 

Genera' Mathematics and Algebra 1* 

KeitH A fiarold E, Mitzel, Marilyn A. Suydam 

Inrs C, oansson, and Pobert V, loo 

The Conmonwealth CAI Consortium v/as initially funded by the U, S, Office of 
Education on '!arc^i 1.0. ,96c, under the provisions of Title III of the Elementary 
and Secondary Ediication Act The purpose of the organization was to develop and 
evaluate two ind i vidun '; ly-adaoti ve nathematics courses for urban high school youth. 
3ecause Pennsylvania n^nth-araders typically take either general mathematics or a 
first course in aioerra^ n was decided to construct both courses in order to begin 
the construction of a Lonolete four-year secondary mathematics program. 

Individual 1> Adapt ive Currjcul^um 

Building a new cu'^r^culum by employing a radically different technology, 
such as comoute-^-assisted instruction, requires careful definition of a plan for 
inplementino tne new comb .nation of curriculum and technology with students. 
The ui'^izafion patt^^n fo^ the Consortium was conceived as an individually- 
adaptive set of niatfiematics exoeriences wUh a predominant theme of teacher- 
momtored indopt^ndent study for each student. The traditional approacn to 
mathematics instrurt'on wth its emphasis on teacher exposition and student 
recitation around textbook themes was drastically reduced . 

The individijd' study curriculum was composed of an "on-line" or computer- 
mediated comoonent "^nvolv^ng student/content interaction at a computer terminal 
and an "of f-hne' conoonent consisting of self-study in a variety of modes, 
such as worksheets, filmstrips, puzzles, games, and textbooks. The "on-line" 
program provided the principle source of continuity within the total curriculum 
with specific carefully-selected "off-line" assignments inserted at strategic 
points in the comouter-mediatcd program. In general the "on-line" material was 
designed as the "basics" or fundamentals of each course while the "off-line" 



*This summary is abstracted from Mitzel, H,E,, Hall, K,A,, Suydam, M,N,, 
Jansson, L,C. and Igo, R.V. A Commonwealth Consortium to Develop , Implement 
and Evaluate ai Pi lot Program of Computer-AsslsteTTnst ruction for Urban HigTT 
^cTTools ; Final ~ Report. Compu ter Assisted Inc t r u ction Laboratory . The" 
Pennsylvania State University, University Park, Pa, Report R-47, July 1971, 



sequences se^ve': enr '.^ ^^.er.n dnr. ••^•ev.r* finctT-.ns Wi:h jiT^^'as's or. enrich- 
ment. 

'!'he uti liza^'ion plan for tne p'^:)iect was adapter! to tne exist-ng eiqht- 
period scbooi 'etv iMint.ces pe^ per'Of^) \.ith abo^^ t^'ice as '^^anv nuoils as 
computer ^er.ninaiS dssiqne^ to tne farili^y darioq any one C'iS<; period. Stated 
another way, the pipil vaKinq average proo»^ess was expected to spend about 
one-half time in "on-line" and one-ha':f time in "off-line" study. With close 
teacher-moni tor";nq prov^d^yJ f?r in tne utilization pattern, friaht, quick s^uien--'* 
were supposed to sper.i sor-ewhat 'ess v.\aa the averaqe one-half period per day 
with the 'on-line fjnrianenta is and t^^e slower students somewhat more than one- 
half time with tl:e "on-line" fondamentals at the computer terminals. These 
plans were mod-.f 'ed ^n practice i^s tl'e schools du-in:^ the last year of the project 
in order to adapt to local needs 

The Computer System 

The IBM !500 con.puter system used in this project is designed specifically 
as an instructional systen. conipute'^ terminal (or student station) consists of 
three display/ response devices w^ijch may be usee individually or in combination. 
The central disp'^ay device is a cathode-ray tube screen (CRT) with sixteen hori- 
zontal rows and forty vertical columns for a total of 640 display positions. 
Information sufficient to fil - the sc^^een is available in micro seconds from an 
internal random access c'isk. One response device is a typewriter-like keyboard 
which makes possit'ie constructed responses by typing the necessary character.. 
A second response device, the liqhL pen, permits response to displayed text, 
fiaures, an^ craphics, by touchina tbe aoprcp'^iate place on the CRT sc/^een. An 
image proiector . utilizino Ifmni filr,, is capable of holding 1,024 colored anri/ 
or black and v/Hite phctonraphic iniaops on a sinoie reel. This device, under 
orooram control, can access imaaes per second. An electronic typewriter 
(proctor station) ) d sf^parate output unit used to deliver messages to the 
teacher reoard mio stiient pe^^formance in the program. 

The 1500 system is capable of accomnodatina up to a total of 3? termina't.^, 
each complete with the CRT and imaoe proiector devices, !^ pictoral diaoram of 
the 1500 system is presented in Fiaure 1. 

Curriculum Opvelopment 

The content for both courses was selected with special regard fc^^- ti.e 
inner city taraet population, thtis the readinn level, for examp-e, was k(>pt to 
a certain level, e.q., terseness was emphasized. Likewise, examples were 
drawn from content and from situatio'-s hopefully experienced by r.he studenis. 
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Fig, 1 A typical configuration (showing one of 
of 32 student stations) of the IBM 1500 
Instructional System, 
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f^hila-^elplna an., '"i^tst uroh '/.,o spent approxinately eiohteen nonths on the Penn 
State canpus. "orkiro lonoA>?.^^ '.i^.h piathenatics eriucators, t^^o teachers identifud 
obiec*:i''?s ar. ' plar.ne' ur its. -'.s .ir-ic pressures increases, ^^ov/evar, specific 
^^el^anoral oi-iac.iv'cs wo-^? nr.it^: ' v;'^,icn resulter! in less consistency and artici ^: 
tion 0^ topir<; as weV as loss er^n^csis on conscious riecisons to employ ir^enti f iab le 
teac'nna s^ra^eoies than was ^inticipated. Thus the ultiniate curricular outcow 
re^lecte^^ V^e inprint of varioiis au^'^ors and viei/points , and continoency decisi 

T^^o flov/char'-s in Figures 3. and a illustrate the sequence of events 
v/ithin thp curri^u^u'^'. The teri^ instruction" as it is use':^ here refers to tha: 
portion of ^he ''lock in which nev ma^-erial is ^rt) educed. The nedaaooical 
aoDroach, whether o^^DOsi ':or^' or in'!uctivG, requires constant interaction of the 
pupil wit*^ the raterial ii t^^ computer and an understandinc of the inter- 
relationships 0^ strateoy and objective. These Generalized flowcharts are 
applicable to '^r,tb V.e alrpbra ap.* tne qoneral mathematics curricula. 

Alpebra . The core content of a standard alaebra 1 course is well defined 
current tex^-bcoks av^ curriculum quides. The scope ^v."* sequence of the mater idl?. 
developed under this project include numbe^^s dnril set notation, properties of 
equality and operations, intpqcrs (properties and operations), operations with 
rational and roa^ r^iinibers, pouations, inequalities anH problem solving, linear 
systems, polynonials. an^ factorino polynomials. 

Th'-* curricii'.ir* oi-i es of t^e Phiiadelohia an-' Pittsburoli school system<^ 
provided the rir^ir^m cortent listing. In addition, there was mutual agreement 
anono f^e aut^>o^ teachers, math coordinators of the narticipatino schools, and 
project sta^f , to seciencc- the material in such a way that it could he used 
with a stan'-'arc' tey.tboo'- (Paters. and Schaaf, W. , Mgebra , ^ Modern /Approach, 
r. Van f'ostrar- . ^n-:. Kf.';) whic! all students would have. The professional 
staff modified an^' excUidoi*. vario'JS alnebraic tonics because the material in 
question was 1) peripheral to the basic alqebraic skills required, and/or 
2) too sophisticated for tHp taraet nopulation at that point in the curriculum. 

.Nt^ouoh the course as it no" exists may not qo as deeply into the materinl 
or as far as many colleqc preparatory courses, it does provide the basic skills. 
It has the adde-^ advantaqe of heina inuividualized with respect to the feedback 
which pupils receive. .Mqetra off-line assignments came from the textbook. 
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A. From orevious instruction dEZ) 



B. 31oc!-: I. (see Fio. 3) 



C. Plock n. (see Fiq. 



P. Chapter Review Test 



D 



I. Chapter Test 
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Fia. 2 Structure of an "on-line" chapter. 
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revie*' '*:est 



0. Student option only 
after 1st iteration 
of block 



N. Teacher assigns ot; 
line material 



M, Teacher informed. 
May assi^"- addi- 
tion ' off-line 
activity 

L, ^'l^ich iterations 
of out-quiz? 



K. Teacher informed 
of 3rd falluro of 
out-quiz 



Piq. 3 Structure of an 'on-line'^ Instructional block. 



A. Instruction frames 
(Topic 1 ) 



Assianment loaderl 



C. Practice frames 
(Topic 1) 

D. Instruction and 
practice frames 
(Topic 2) 
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G. Failure to meet out- 
quiz criterion 



Fiq. 4 Structure of "on-line" instructional 
material . 
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General ^'at'^ematir^ . ihp af^,r)era} malhe^^atics course includes inst'^uction 
in equations, peaa''ive into.-^ers. division of w^-oie nunhers (rei ec^ial only) 
decimals, ^'rac'-i-ns, rati^ an.! .•ropor^:ion, percent, fonr.ulas, neometry, measure- 
nent, nn-' nn^u^^ira. ?r,no "opirs Ireuitionan v consi'^ere'^ to be part of alqebra i, 
such .-s pnua'im^.. i"--fa^i i :s :nr!:itive inteaers, and araphinq with cooniinates, 
as w^n as arithnp':ic rcviO ' './ero also inclU'er'. 

of-r.iipe up-!' in^ju^"-^! "srrr'^al'' ' in t'le ^•?on?^ry an^ graphing units, 
activi'-i'^s ^•♦:^er ^-^an r-.'\<=^ '-Irill. ' .ani pjl ati ve and ^'rav/ina tasks were include^ 
in re'^ular assinn^^cn^s . 

Fvaluatiop 

jua ^'^n . - c '-v .--i-^^ ^ ^^^d 'VontroT' in describ'''na the groups 

use^ in the ev^lu^'-iv'^ sto- 'a^. bep*^ avo-i^'ed. The TAT nro'm" vas t»^e one in 
^'hicb tHe romciiter was jse' assis- the instructional nrocess, v;hile the "cohcr^ 
orouD was tbr <^re in v.hir'.i th? crmputer v;as not a component of the instructiona i 
procpss (".ra '1ti..i.3". -^""^^s^s). Sinco all available noneral natheratics and 
aloebra 1 cl^-s-'s - '^^w ' io^ Sc*^ool in Pi+tsburoh were included in the CAl 

qrouu, it »'as nvT^ss^^rv Lc sclent ro' ort prou:?s fron a sinilar but net identical 
schncl (Peabc^y i io^^ S-Hool). Thil^^^elphia , both CAI and cohort classes 
v/ere '^ravin frci^ !Jn^o"'r ' i.^'^ Sc'*^ol . Ta^le 1 indicates the total number of 
students in^'o^^'G^ i'' ^^-^r^^ ctr^^Ji,? i*^ each school. 

Table i 

"n"a1 '''im^^er of '^t»»^^en'*'s in 



^'•-neral :'3tbe'^atics /^Igebra 



rq r.ohort CAI Cohort 



Pitts^^urq»- Scbenlpy x 25^ x 

Pea^o'y x x 97 

PMlaHelpM.^: '.iPCcTn '^'^'^ 77 221 1^4 
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Since many students were absent on testing days, the nuniber takinq various tests 
and those who took all tests is an additional source of variation in standard 
laboratory research procedures. 

A set of criterion measures v/as selected and developed to study the effect 
of the varyino mo^es of instruction on the achievement of students in algebra 1 
and neneral mathenatics cour^*'" se pre- and post-measures were usually 
administered by the teacher u.ie assistance of a member of the evaluation 

team. In a^^'dirion, formative evaluation of course content and of student achieve- 
ment in various sections of the courses was continuing during the school year. 
Thus, renular, on-line chapter tests and mid-semester tests v;ere administered 
to the f-'^I qroup, and the teacher's usual testina orooram was conducted in the 
cohort nrouDS. Information derived from t*^ese tests was used in revision of 
the courses and for assigning mar!;s to students. 

Evaluation Instruments . Both non-normed and normed tests were used to 
obtain measures of student achievement in each course. The term "non-normed'' 
achievement test was coine*^- to reflect the fact that there is no independent 
set of descriptive statistics concerninq the sets of items used. These two 
tests, one for alof-bra and the other for general mathematics, were designed to 
reflect th. fundamental objectives of the Consortium curricula as closely as 
possible. It W8G necessary in the operational settings of schools to restrict 
the amount of student time devoted to evaluation to an absolute minimum. 

The off-line ron-normed achievement test for general mathematics (33 
items), develope^^ by Jansson, was designed to measure mastery of 1) computa- 
tion with the four operations with whole numbers and with positive rational 
numbers in fractional and decimal form, 2) ratio and percent, 3) linear 
equations, and 4) geometric concepts. Equivalent forms were developed to 
serve as pre- and post-measures » containing identical items arranged in a 
different sequence. 

The off-line non-normed achievement test for alaebra (32 items), 
developed by Beardslee and Jansson, includes both knowledae-level and under- 
standina-level items of ^^oth computational and abstract-manipulation types, 
drawn from test-item pools from all chapters in the course. The posttest 
was an equivalent form, containinq the items from the pretest ordered in a 
different sequence. 

ERIC 



10 



The ftarfoH ^'c i)ievenent Test, Hiqh School Pas'lc I'attery, Test 2: 
"umerical Crnpe^encr- ('5 iters). \'as used as a non i-referencGc.: n.easure for 
qeneral pat' e'^atics stu^'ents. Forms aivi ^' K'erc use'' as t^^e pre- and post- 
^■es^<; respe'^t'iv^ = T^^- rcoperati ■ lathpratics T g s , /'^laobra I (4^ itef^^s), 
was ufO'''' a porr reference'' reasure for alqebra students. Forns A and C 
viere use^^ as pre an^-! posttests respectively. 

Fin^inos 

For V^Q statistical analyses to test the various hypotheses with sufficie; 
precision, i^ was necessary to use rlata only for those stiiuents fron v/hom all 
pertinent scores were available. Thus, data from only those students who had 
taken both pretest and posttest versions of t^oth achievement tests wero used — 
657 students. In each instance, the assumption remains that the exclusion of 
data ^or those stuf'ents for w^om data were incomplete does not bias the remain- 
ino samrV^ for whom data are complete. The "abridned' data \/ere used in all 
statistical analyses. 

All null hypotheses were tested for sianificance at the .ni level. 

No attempt was ma-^e to compare data from the two districts, nor from the 
two courses. Thus, the data was treate-^ as if derived from four separate 
sources: neneral mathematics and alqebra, in Pittsburgh and in Philadelphia. 
Table 2 shows the hinh an(i low observe-^ achievement scores for all groups 
on both the norme^ and non- normed achievement tests. 

^!on-norme' Achievorent Test Data . V^e data from administration of the 
non-norme^' ac'^ievenent tests was analyze*-' usina Analysis of Variance. The 
hypothesis ^eira teste^ v;as ^he same in eact^ of the four situations, for 
Pittsburoh oeneral mathematics Pittsburoh alqebra, P^^i ladelphia oeneral 
mathematics, ar-' Philadelphia alqebra aroups: 

T^:ern is no difference in achievement on the non-norme^^ 
test (qeneral mathematics and aloebra considere'^ separately) 
between qroups followinq CAI or ncn-CAI instruction, as defined. 

In the case of the non normed achievement test, it seemed wise to 
attempt to adjust the posttest scores of the students in order to compensate 
for the fact that many of them did not complete the total pronram of 
instruction, ^hen students are allowed to pace themselves through content 
material, and when absentee rates vary from n to 75 percent of a 180-day 
school year, thpre are inevitable fluctuations in the amount of course material 



Table 2 

Hfgh and Low Observed Achievenent Scores for All Groups 



Pre-Instruction Post-Instruction 
ncn-nomed normed non-normed normed 



Pittsburgh 

Genera' Mathematics CAI Group 7-27^ 3-40^ 7-31^ 1-38^ 

General Hathenictics Cohort Group 8-33^ 3-36^ 4-29^ 2-38^ 

Philadelphia 

General Mathematics CAI Group 7-25^ 1-30^ 7-30^ 5-29^ 

General Mathematics Cohort Group 7-30^ 6-31^ 7-28^ 6-32^ 

Pittsburgh 

Algebra CAI Group 4-18^ 2-20^ 5-26^ 3-28^ 

Algebra Cohort Group 6-24^ 5-24^ 3-29^ 5-29^ 

Philadelphia 

Algebra CAI Group 2-19^ 1-21^ 5-28^ 7-28^ 

Algebra Cohort Group 4-24^ 4-28^ 4-24^ 6-27^ 



^The non-normed achievement test for general mathematics contained 



33 1 tems 
b 



the nonred achievement test for general mathematics contained 45 items. 
^The non-normed acnievement test for algebra contained 32 items. 
^The ncmed achievement test for algebra contained 40 items. 



dcttiall;/ a^tcr;*! . Tahles ' ^ s^"^" cunul''^tiv?1y t'^e oroportions of s'':udents 
in V^e fo:,'r orcms 'h^ co\n^]'^ie/^ each chapter of either t^^e aloe^ra or aeneral 
iTiat'^ern"!-;c^ cours', an*' "^,^.[1^ ^ V'z axtrones nf dhsences an ' amount of tiine- 

on-line "rr a*"' -r " s. K a rv'-s'^er ■*:or..i ..^ > 2 ' r;nri, t' a i haTf-'-'av t^^rounh 
a particular c'vi.'^.er.. t'-e': ho vas ro -r.t:: ' as cor\jl etira it. ^osttest scores of 
every stu'^'-DL ^t*^-^ e; a'i'js-:-?! "^r.- a ' aso of ^ither 33 itt^is (aeneral nath) 
or a '^ase '"^ j^.-^^-s (a • oe'^^a) . "'""'js. as s^oi'r in Ta^le a stu^ert who finished 
Chapter f of ac '"'^:"! fr,a ".he'^a'^.ics siv^ul ' ha^'G ^een aLle to ansv.'er 22 test quesuions 
correctly, "^ix-^^^p '-p "c' '.t i "J \ ansi.crf^ > rov^rnctV/ ?n. "is a'^i"ste^ score becan'e 
?{)/?? 0- -r ^. . 

Table 6 shc's a cnr^parisop o-^ the 'na-'juste-: an-^ a^^iuste^ posttes^ means. 
The a ■ius*""^0'"* ' zrf^r^'^e/^ 'sti:ac9. in^.rras.^s ^^ '^astory le^'el (?ercentaoes of 
test ite*\s c-rrc^":'^ f^^c^ / ")cy^r^\' :o l"! '''rrcert. T^e a^ijste^' scores were 
use ' in the co'^?a>^i sons ■'i"^h th^ cohort pro^'p in ''"a^ le 7. 

.T.oT/sis '^■f' verianc^ sho*'e'"' that Lie ircrease in achiever^^ent score between 
pretest an^' dc^^^cos^ f^r ^h*^ T'i t^-qlMjrr'h n^^^erai »^\at'^er atics nrouo was sionificantly 
areate*' for ti^e »' 'I nroup than f-^r t:>s co'iort aroi.p ( 1 li:strate ! i;: hiaure 5). 
The s,\ne 'les tr-jo f^r r^p 'el.^hi: nenrral patheratics oroup and is illustrated 

in Finure T. '^Mialysis cf variar.ce als*:^ shce--' that ^he increase in achieve^^ent 
scores hp-weer pretes^ cn..; /^sttest for che r^ittsbMrah aloe^^ra aroup was signifi- 
cantly orea^^^r ^nr t'-^e T/M qrou;: t'.^r for the cohort nroup (illustrated in 
Fiqnre 7). T';e sa.riP -ras ':r.ie for the '^hila 'elphia alo^hra CM nroup and is 
i 1 1 i:<;t»^a'^e'' "'^'^ FiosT*"' 

^'r tre rr'V-'-rr'^\^'' ac'ie^'e^en* ':ests, t'.p ^'.1 oroups in Loth school district*^ 
in ho"-'-^ i.af^e T. ■ i ^s oo'»--ses /a^^o sinnif i cantly qretiter increases in achievement 
srore^ hpt;..'^r. -.r'^t^^st a-^: ' :.os:t6st thar. 'i' t'-^e co-^ort nrnnps. The replication 
of t'-'is resi'l"- i<^ ir^'icative ':He offiracv of the non-nor"^i^d test for each aroup' 
in ascerra^v!--- ";.o"i;or ^r no^ ''^.Q zrr,crr^.-s. v/«re effective. 

fjorne'' ^c''iever-en t "^est ^ata. The flata fro"^ administration of the norm^J 
achievepent tes^s was also analyze-: usinq ."nalvsis of Variance. The hypothesis 
^^einn ^^es^e-^ ^'as ""he s^ne i.^ eac^^ of +'^o to"r situations: 

There is on '^i'^feronce in ac^nevepent on the normed test 
(oeneral -^at^^ematics an ' alnehra consi^'erec! separately) betw^^en 
oroups f: I lo'.;i PG "^/M or non-C;^! instruction. 
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Table 3 

Number and Percentage of Students who Completed 
Each Chapter in the Consortium 
Course in General Mathematics 



Through 
Chapter 


Number of 
Students 
Terminating 
in Chapter. 
Pittsburgh 


Cumulative 
Total 


Number of 
Students 
Terminati ng 
in Chapter. 
Philadelphia 


Cumulative 
Total 


Cumulative 
No. of Test 
Items Rela- 
ted to Each 
Chapter 


1 




233 


100% 




222 


100% 


3 


9% 


2 


8 


233 


100% 




222 


100% 


5 


15% 


3 


3 


225 


97% 




222 


100% 


6 


18% 


4 


80 


222 


95% 


16 


222 


100% 


13 


39% 


5 


28 


142 


61% 


46 


206 


93% 


19 


58% 


6 


27 


114 


49% 


30 


160 


72% 


22 


57% 


7 


25 


92 


39% 


56 


129 


58% 


26 


79% 


8 


13 


67 


29% 


28 


73 


33% 


28 


BS% 


9 


52 


54 


23% 


42 


45 


20% 


29 


88^ 


10 . 


2 


2 


1% 




3 


1% 


31 


94% 


n 














33 


100% 


Termination 
















Date 


6/4/71 






6/16/71 











14 



Table 4 

Number and Percentage of Students who Completed 
Each Chapter in the Consortium 
Course in Algebra 



Through 
Chapter 


Number of. 

Students 
Terminating 
in Chapter. 
Pittsburgh 


Cumulative 
Total 


number of 
Students 
Termi nati ng 
in Chapter, 
Philadelphia 


Cumulative 
Total 


Cumulative 
No, of Test 
Items Rela- 
ted to Each 
Chapter 


1 




243 


100% 




220 


100% 


5 


16% 


2 


22 


243 


100% 




220 


100% 


7 


22% 


3 


71 


221 


91% 




220 


100% 


14 


43% 


4 


110 


150 


62% 


32 


220 


100% 


17 


53% 


5 


26 


40 


16% 


123 


188 


35% 


21 


66% 


6 


n 


14 


6% 


40 


65 


30% 


23 


72% 


7 


3 


3 




25 


25 


11% 


29 


91 


8 














30 


94% 


9 














32 


100% 


Termination 
















Date 


6/4/71 






6/16/71 











15 



Table 5 



Extremes of Number of Absences and 
Amount of Time-on-Line for All Groups 



Pittsburgh 

General Mathematics 
CAI Group (N=140) 

General Mathematics 
Cohort Group (M=8y) 

Philadel phi a 

General Mathematics 
CAI Group (M=220) 

General Mathematics 
Cohort Group (IJ=77) 

Pittsburgh 
Algebra CAI Group (N=254) 
Algebra Cohort Group (n--97) 

Philadelphia 
Algebra CAI Group (N=221) 
Algebra Cohort f^roup (ri^l04) 



Absences (In Days) 



1969' 



0-91 



0-55 



0-30 



0- 62 

1- 35 

0-43 
0-36 



Time On-Line 
1970 1971 (Hours) 



0-127 0-140 



1-63 



0-41 



0-37 0-60 



0-78 
0-34 

0-43 
0-67 



0-62 

0-42 
0-65 

0-87 
0-53 

0-61 
0-47 



- 66.78" 
None 

24.82 - 57.83 
None 

- 81 .97^ 
None 

16.30 - 68.27 
None 



''Acadennc Year 

'^A meaningful mimmuni figure was not available for this group. 
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Table 6 

Comparison of Adjusted and Unadjusted Mean 
Posttest Scores and Mastery Levels for 
CAI Groups on Non-normed 
Achievement Tests 





n 


Unadjusted 
Posttest 
Mean 


Mastery 
Level 


Adjusted 
Posttest 
Mean 


Mastery 
Level 


Pittsburgh 
General Math. 
(33 Items) 


101 


19.57 


59% 


20.18 


61% 


Philadelphia 
General Math. 
(33 Items) 


156 


17.45 


S3% 


20.17 


61% 


Pittsburgh 
Algebra 
(32 Items) 


135 


13.86 


43% 


15.82 


49% 


Philadelphia 
Algebra 
(32 Items) 


183 


17.43 


54% 


20.65 


65% 
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Fig. 5. Mean scores on non-normed achievement test for Pittsburgh general 
mathematics groups. (Abridged Data) 
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Fig. 6, Mean scores on non-normed achievement test for Philadelphia 
general mathematics groups. 
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21 
20 
19 
18 
17 



Mean 
Scores 




8 
7 
6 
5 
4 
3 
2 
1 

Pre Post (Adjusted) 

Testing 

Fig. 7. Mean scores on non-normed achievement test for Pittsburgh 
algebra groups. 
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Fig. 8. Mean scores on non-normed achievement test for Philadelphia 
algebra groups. 



The reans for all orcups are presentpH in Table ^. In eacb situation, 
there v/as nc significant interaction effect befrveen type of instruction and pre- 
DOSt aain. T;:e r ill h>oothesis s^'ate^l ahove '-'as not reiecteu. There \'as a 
siqrificant t^s^i^o '^^ain ef^'e^" in all cas's, in-licatina an increase in achieve- 
ment scores -^or :11 n-oups- t^e four groups all sho^^'ed irprove^ent from pre- 
test to pos^test. 

The -^act %hat students in hot^ CAI and cohort qroups achieved a mastery 
level of 30-40 Dercent on ^he n'^rme^' achievement "-.ests casts considerable doubt 
on the r^rieqijacy ^f ^h<=s<= tests for r^easurinq studen.. ac^neve^^ent over t^o 
senesters. T'^e chtai'^e^' Mffr^rences were not significant for ^1^1 anr* cohort 
croups . 

Summary 

V^e results ov the statistical analyses ir.^icata: 

1) On the nop-no'^ne" achi'^verent test, t^e Z^l gmuos marie significantly 
Greater increas?=^s in acbioverent than did the cohort aroupi.. The reader Is 
reminded that t^e non- norreo achievement test was based on the Consortium 
curricu'lui-:. 

2) Three of the four ZPl qrouos attained a mean adjusted m<:stery 
level of 60 percent on the non-norre^^ achie^^ement test. 

3) On tl^e normei' achieverient test, no significant differences between 
CAI and cohort cironns vere four 'J. 

The two type^ of achieveir.ent tests vere hig!;ly correlated, yet the non- 
norned tests apparently provided a more precise measure of the achievement of 
tho'^^e students havinc cnmputer-assisted instruction than did the normed 
test. This '''indinc cojld anticipate-^', since t'^e non-normed test was 
written to "est the obiectives of tne CM course. The results indicate that 
students can achieve at least as well with the use of CAI as fron conventional 
instruction alone. 
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